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ABR! 


Linear programming has been used to maximize alloca- 
tion problems in many fields. This technique will be 
applied to the problem of planning research with optimal 
allocation of limited resources. A model is constructed 
with detailed information concerning necessary inputs and 
resultant outputs, amplified by sample problems. A sensie= 
tivity analysis and interpretation of all results is 
included. The model has been constructed to be of primary 
interest to the Office of Naval Research but can be adjusted 


to the needs of other groups engaging in research, 
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INTRODUCTION 


In recent years, the increased emphasis on research and 
development, by beth private and governmental organizations, 
has raised the questions "Can research be planned?" and "If 
SO, Can it be planned optimally?" This report concerns the 
second question, the problem of the optimal allocation of 
funds for the accomplishment of a research objective. The 
technique proposed in this thesis to answer the second 
question is linear programming. 

Linear programming was first suggested as a technique 
to explore the area of research planning by Dr. Fred Rieby 
of the Office of Naval Research. His paver "Activity Analysis 
of Research Planning in ONR", written in 19634 proposed the 
feasibility of constructing a model predicated on the re= 
search effort of ONR and utilizing linear pvbrogramming. 

Prior to the paper by Dr. Rigby, the Office of Naval 
Research had completed a study of research planning which 
was called the "Ad Hoc Research Planning Committee Revort,.” 
This study effort was headed bv Captain J. F. Gustaferro, 
USN. An outgrowth of the study was a report by Herman I. 
Shaller, also a member of the Ad Hoc Committee; his report 
is titled "An Exploratory Study in Research Planning Method= 


Slory". 
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This thesis utilizes the information in the above 
reports and 1S an attempt to implement the suggestion made 
by Dr. Rigby to utilize linear programming for the investi-= 
gation of research planning. 

For the purpose of the thesis, an organization diagram 
of ONR, Appendix 4, has been simplified into the following 


form: 


tis 


Branch Heads Peace L ae diac) ans ee Ces 
Category | [ategory ]f 
Category 2] Category 2| Pategory 2| 


A total budget is received by the research head, and 








1S passed on to the department or branch heads. These 
individuals, each heading a particular scientific field, 
such as biology or physics, must then decide how to allocate 
available funds .among the various activities comprising 
their particular departments. The smallest sub-division 

of a varticular department engaging in research is called 

a category, Examples of categories in the Electronics 
Department of ONR may be found in Appendix 3, vage (72 )., 
This thesis assumes that the department heads will divide 
the total budget among the categories rather than by making 


an initial allocation to the departments. The problem, 





therefore, is that of dividing the bideet among the catepories 
to maximize the research effort. 
To maximize the research effort of the organization, the 


particular mission of that organization must be examined. 


mie mission of ONR is:t 


to encourage, promote, plan, initiate, and coordinate 
naval research to provide for the maintenance of future 
naval power and the preservation of national securitv; 
to conduct naval research in augmentation of and in 
conjunction with research and development conducted 

by the respective bureaus and other agencies and 
officers of the Department of the Navv; to supervise, 
administer and control all activities within or on 
behalf of the Department of the Navv relating to 
patents, inventions, trademarks, copvrights, royaity 
nayments and matters connected therewith; to represent 
the Department of the Navy in dealings of Navy=wide 
interest on research matters with other government 
agencies, corporations, educational and scientific 
institutions, and other organizations and individuals 
concerned with scientific research; to survey the 
world-wide findings, trends, potentialities and 
achievements in research and development, keep the 

ASN (R and D) and the Chief of Naval Operations ad- 
vised thereon, and disseminate such information as 
appropriate to interested bureas and offices within 
the Department of the Navy, and to other Governmental 
or private agencies, 

Far the purpose of the Linear programming model. this 


mission must be described by a particular distinct set of 
objectives which must be internaliy independent. ONK calls 
—nese objectives attributes. Clearly the missio» of an 


organization may be described by more than one set of attri- 


butes or objectives. Each particular set of attributes 


toffice of Naval Research Organizatior Manual, ONR 
ihSt. OF70. lt «= fuee LU6l 





which describe the mission is called a Classification system, 
Examples of attributes in a classification system might be 
scientific value, military value, and technological value, 
Examples of other classification systems used in the Navy 
are shown in Appendix 3, page (73). Therefore, attributes 
are organizational objectives, 

Inter-relations and dependencies exist between Navy 
bureaus and the research activity of ONR. An example of 
such a situation may be described in this manner: Assume 
that scientific value, military value, and technological 
value comprise one classification svstem, and that anti- 
submarine warfare, air warfare, and surface warfare are 
another, both describing ONR's research effort. Increased 
research activit: in underwater sound transmission will not 
only affect the military attribute of the first classifi- 
cation system, but the anti-submarine warfare attribute 
of the second classification system as well. The model is 
developed to recognize these interdependencies and still 
achieve an optimal resource allocation with consideration 
given to other classificaticn systems, Therefore, category 
Support in one system will affect results in other classi= 
fication systems. 

To apply linear programming techniques to the problem 


of research optimization involved translating the following 





linear programming concepts: maximize olx subject to con- 
straint equations AX>b and X20, where A denotes the 
technology matrix, b denotes the requirement vector, ot 
denotes the cost coefficients and X denotes the unknowns. 

Symbology and definitions used in the above trans- 
Slation were originally formulated by H. Shaller [4]. His 
paper outlined a method of displaying an existing research 
program in matrix form. This report attempts to find a 
method of maximizing the results of a research program as 
well as finding the most effective way to change the program 
when new conditions arise. 

In the proposed model, the unknowns to be determined 
are the amounts of funds to be assigned to a category to 
optimize program effectiveness. These unknowns are denoted 
by X. cl denotes a set of coefficients reporting the effec- 
tiveness of a category to the mission of an organization per 
research dollar invested in that category. The term 
category effectiveness refers to the amount of progress 
made in achieving the mission of the organization per dollar 
input to that category. Therefore, clx is the objective 
function to be maximized. 

To utilize the experience of the research manager, 
constraint equations are formulated so that the require- 
ments vector b is composed of the set of all category 
funding levels. Each category has two furiding levels. 
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These funding levels are the lower and upper bounds on the 
amount of funds the research manager desires to spend for a 
particular category. A lower funding level may be computed 
by determining the minimum amount of funds a category must 
receive if any research is to be accomplished. An upper 
funding level can be chosen from a history of past funding 
to a particular category or by the research manager 
evaluating a category's potential contribution to his 
mission. 

Because of formulating the constraint equations in this 
manner, each element of the technology matrix A takes on a 
value, -l, 1, or 0. Therefore, the objective function is 
maximized by selecting levds of category funding between 
a lower and upper funding level previously determined by the 
research manager. Further explanation and examples of 
these concepts are found in the sections titled Model Inputs, 
page ( |9). 

The questions to be examined in this thesis were 
originally discussed by the author with personnel of ONR 
during a summer assignment there in 1963. 

these questions were also posed in the Ad Hoc repor 
previously completed. They are: 

1. What is the effect of a budget alteration on the 
present research program? Can all categories continue to be 
supported? What activities must be curtailed or reduced, 
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and by how much, to achieve optimum propram effectiveness 
within this new budget? 

2. If anew category is added to the research program, 
how must I modify the existing program, What is the optimal 
way for this change to be accomplished? 

3. What is the effect of a change of emphasis on the 
program? How should a reallocation cf funds to accommodate 
this change of emphasis be made? 

These questions are not necessarily exhaustive. New 
questions may occur to the reader which can be answered 
by applying the linear programming technique, 

To answer these questions six problems were arbitrarily 
developed. These problems were solved with the aid of the 
CDC 1604 computer of the Naval Postgraduate School, Monterey, 
California. Because of the tedium involved in applying the 
linear programming technique to a large problem and the 
difficulty in inverting large matrices, computers are 
essential in applying this method. Because computers must 
be used in the solution of the problem, care must be exer= 
cised to insure that the size of the problem formulated 
does not become insolvable due to limitations of existing 
computers. The problems would be unmanageable if too many 
constraint equations were formulated due to a large number 
of categories in use. Grouping of categories might then 


be necesSary, 





The data used in the sample problems of the thésis 
are arbitrary and have no particular significance. The 
first two problems are maximizations of a program's 
effectiveness when two different classification systems, 
identified as A and B are used to identify the same research 
program. The results of these problems indicate the 
allocation of funds which optimize program effectiveness. 
Problem three combines the A and B system by arbitrarily 
adding their objective functions. The results are not of 
preat interest unless a research organization can operate 
in this manner. Problem four examines the effect of per= 
turbing the requirements vector. Problem five, the most 
interesting, and perhavs most useful, examines the effect 
of optimizing the research effort of a particular classifi- 
cation system when subject to the constraining influence of 
another classification system. This problem approaches 
realism to a greater degree than do problems one and two. 
Problem six explores the effects of a budget cut on the 
research program, A sensitivity analysis is conducted on 
problem one to evaluate the sensitivity of the solution 
obtained with respect to variations in the input parameters. 
Detailed results were obtained for all six problems. From 
these results the following general conclusions can be 


drawn: 
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The linear programming model can be of great 
assistance in planning a research vrogram providing 
a means of evaluating the reliability of the input 
data exists. 

To assist in formulating the input data, further 
studv is recommended into the problem of quanti- 


tativelvy measuring the output of a research program. 
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Sao UMP TIONS 


Primary Assumptions 

For model construction purposes, it iS assumed that the 
total research domain can be divided into subdomains of 
manageable size, that is, the number of categories does not 
result in too many equations for solution by present com- 
puter techniques. Homcgeneity in the branches and 
categories must exist in order to establish independence 
among the linear equations to be formed. Homogeneity can 
be approximated through proper category definition. For 
our model, homogeneity and manageability of the branches 
and categories are assumed to be present, 

The program managers, through judicious application 
of management techniques, achieve within-activity optimi- 


1 This implies that for a given resource input 


Zatlon. 
to a category, the research manager will so use his resources 
that the quantitv and quality of research output is opti= 


mized. A graph of the relationship between resource 


input and research output 2 follows: 


lRisby, F, D, Activity Analysis of Research Planning 
MmeONR. 1963% 


2Ad Hoc Research Planning Committee at the Office of 
Naval Research. 


a 










Upper threshold point 


Research output 


Lower threshold point 


Mesource mput 


Sraoh 1 


The lower portion of the curve exemplifies that situa- 
tion where a research project has just begun. In this range, 
output in relation to input is low. Possible reasons for 
this may be that the group has not "jelled," proper equip- 
ment 1S not vet on hand, or the problems themselves are not 
completely formulated. The major portion of the curve is 
approximately linear with an unknown slope, Here, the 
assumption is made that a large number of workers adequately 
financed will progress in a linear manner toward solution of 
a problem. Research teams are now organized, goals have 
been set, and all the inputs are now present for problem 
resolution. This area is the most prevalent one in today's 
research organizations. The upper portion of the curve 


constitutes a region. of diminishing returns for resource 
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input. Such a condition may occur when severe scientific 
roadblocks, requiring a major breakthrough to clear, are 
present. An example of such a situation might be the 
problem of finding a light but effective shielding for 
nuclear reactors to be used in automotive transvortation, 
Peeregion of diminishing returns might also occur if 

adequate experimental equipment or sufficient new scientific 
personnel were not available. 

Two points of interest, therefore, are the lower and 
upper activity thresholds. An ability to estimate the 
lower threshold point would enable the research manager 
to evaluate when a large output return would be imminent 
for small resource input. Knowledge of the upper threshold 
point would enable him to partially shift his resources to 
another category when diminishing output was impending, 

An evaluation of these threshold points will not be 
attempted in this report. 

Studies are presently being conducted to examine the 
feasibility of measuring research output. As vet no such 
measuring device for ONR has been found, thereby necessi- 
tating another major assumption. The efficiency of a 
particular category with respect to an attribute 15 a 
necessary model input. This efficiency is defined as 
research output divided by resource input. The sum of a 
category's efficiency to all the attributes must equal one, 


ig 





Consequently, estimates of category efficiency are entirely 
subjective. Therefore, we must assume that experience will 
enable the project manager to make a reasonable estimation 
of this quantity. This subjective estimation is a model 


weakness, 


Secondary Assumptions 
It is logical to assume that a certain level of resource 
input per category is essential if a meaningful amount of 
research is to result. The minimum amount of financial 
support a category must receive if progress is expected 
must therefore be established. It is assumed that meaning- 
ful research can be accomplished with a minimum of one 
unit of research 3 where a unit of research is defined 
as the research input necessary to support the average 
research scientist for a given time interval. For model 
purposes, the time interval will be one year. A necessary 
lower bound on category financing, therefore, 1s the cost 
of maintaining one unit of research ina particular category. 
The determination of what constitutes a "research 
scientist" and the evaluation of his work is entirely 
subjective. Junior researchers may be weighted less 
3shaller, H. I. An Exploratory Study in Research 
Planning Methodology, ONR Report ACR/NAR=27, Sept. 1963. 
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heavily than senior researchers. Greater emphasis may be 
placed upon the work of a perticularly outstanding individual. 
By appropriate adjustment, therefore, the unit of research 
will be used as the least common denominator for all quanti- 
tative arguments. 

For purposes of simplicity, the proposed mode] will 
not include those conditions where financing is done over 
a period greater than one year. If these constraints are 
desired for practical application purposes, they may be 
formed as yearly ratios and included in the «rray of 


constraint equations. 


i 





CONSTRAINTS 
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CONSTRAINTS 


Optimization of the research effort is defined as that 
set of resource allocations which achieves the greatest 
effectiveness under a given set of constraining conditions. 
Constraining conditions are essentially those bounding factors 
which the research manager desires to be considered in the 
overall solution to his problem. The restrictions to be dis- 
cussed are budget constraints, balance constraints, and 
threshold constraints. 

Budget constraints consist of those limits superim- 
posed on the research program by monetary considerations. 
These budgetary allocations may be presented in a number of 
forms; aS a Single ceiling under which the research manager 
must conduct his entire program; as a series of budget 
ceilings placed on individual branches or categories. In 
the former case, there exists essentially one bound, while 
the latter example contains constraints equaling the 
number of categories individually budgeted. 

A threshold constraint might be defined as the minimum 
resource allocation to a category necessary to conduct 
meaningful research. It has been previously assumed that 
meaningful research can be accomplished with a minimum of 
one research unit, therefore the threshold constraint per 


category is the cost of maintaining a research tnit ina 


V7 





particular category. The expression "meaningful research" 
is subjective. As there does not exist a measuring device 
for research output, the "one unit of research" criteria 

was chosen essentially by experience. Therefore, the cost 


criteria for "meaningful research" can be chosen arbitrarily. 
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MODEL INPUTS 


Five items will be discussed as inputs to the model, 
of which two are constants, two are subjective variables, 


and one is a subjective constant. 


CONSTANTS 

A total and fixed budget over a vearly interval must 
be specified. This budget may later be influenced by the 
conclusions drawn from model results, but a fixed amount 
of dollars for research purposes must initially be deter- 
mined, The total budget for ONR is determined within the 
Defense Department. X will denote the total budget. 

As previously noted, a unit of research is defined 
as the resource input necessary to supdort the average 
research scientist for one year. The cost of a unit of 
research will naturally vary widely.among different 
categories, depending upon the area of investigation. 
A research scientist engaged in subatomic particle study 
might require the use of highly sophisticated equipment 
while a mathematician investigating a theorem might need 
only pencil and paper. Cast per research unit ina varti- 
cular category might also include such items as floor space, 
Supporting personnel, salaries, and overhead, The tctal 
cost per research unit in the ith category will :e denoted 


by Ce) 20 





SUBJECTIVE VARTABLES 

The overall mission of an organization is clearly speci- 
med in terms of such attributes as maximization of profits, 
maximization of military might, or maximization of research 
progress, After breaking down a specific orpanizational 
mission into its attributes, a decisior must be made as to 
what emphasis is to. be placed on each attribute. The 
emphasis factors will be in percentage form, with their 
sum equal to one hundred percent. The decision as to what 
Sertributien an attribute is to make to the overall mission 
will originate from the upper levels of an organization, 
The direction a research organization will take is now 
determined, CCA;) will denote the contribution of the 
sthattribute to the overall mission, 

Another model input is the approximate emphasis that 
is to be placed on each category. This factor may be 
determined from study of the history of the organization, 
from an estimate of the importance of a particular category 
to the overall mission, or from empirical observation, 
This decision would usually be made at a lower organizae- 
tional level--in ONR by the department heads. These 
estimates are to be assigned in bracket form. For example, 
10 to 15 percent might be assigned to category one, and 


S30 to 40 percent to category two. Care must be taken to 
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insure that the sum of the lower estimates is less than 100 
percent and the upper estimates sum to greater than 100 
percent. W(C;) will denote emphasis to be placed on the 


gh Gace cory. 


SUBJECTIVE CONS mith 

The efficiency or progress a category contributes to 
an attribute has previously been discussed in the section 
meeled ASSUMPTEONS, The project manager must decide whan 
contribution his category makes to a particular attribute. 
The sum of these percentages must equal one hundred. The 
degree of difficulty in making such a decision will naturally 
vary with each category. A category such as protazanda 
obviously has a large preponderance of military rather 
than scientific value. A project manager concerned with the 
propaganda category may decide therefore that 15 percent 
of this category contributes to attribute one, 60 percent 
to attribute two, and 25 percent to attribute three. It is 
recognized that this subjective estimate may at times be 
very difficult to make. Progress contributed by the ith 


category to the jth attribute will be denoted by Dean 
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MODEL INPUTS 


X = total budget 


CCA; ) - Contribution of the jt attribute to the overall 


meussLon, 


W(C;) - Emphasis placed on the ith catepory 


: sitet : 
P34 - Progress contributed by the ?t category relative 
| to the 3th attribute per dollar, 


K(C.) - 


where: 


N 


Lie 


Total cost per unit of research in the ith 
CaveecOry. 
K(C; ) is expressed as: 


GCs) vance 8 ie es 
(C;) a;Z;+ Davit CrWet devices 


alee 


Coat 
scientist year 


scientist vear 
unit of research 


COST 
ne yi se 
unit of personnel 


unit of personnel 


unit of research 


COs 
sq eft. of office space, lab snace.o. 


sq.ft. of space required 
unit of research 


COsc 
IR ICD « . 
unit of equipment required 


piece of equipment required 
unit of research 


Scientist vear -- unit of research 
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MODEL] OUTPUTS 
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MODE EeOUmeU is 


Direct Output 

After consideration of the inputs previously discussed, 
the model indicates the amount of resources to be allocated 
to each category. : The resource allocation to the ith category 
will be noted x;. 
Computed Output 

Upon arriving at a set of optimal resource allocations, 
certain additional quantities may be of interest. These 
values will be displayed in matrix arrays as formulated by 
H. Shaller in An Exploratory Study in Research Planning 
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Methodology. [4] 


COMEULE DS MODE CUO. 


ile uve Number of research units in the it category. 
2 a ae of research units in the it category 
corresponding to the jth attribute. 

S Bi 5 = Lffectiveness of the ith Cabepory relative 
to the jth attribute to the overall :.ission. 

tee a ecerVeness Oke tiie ith catepory relative to 
all the attributes per research unit. 

Ors Et =—"Ptrectivemess of the jth catesory relative to 
all the attributes per research unit. 

ere = Total effectiveness of the research program. 


a (Bs )=Emphasis resulting on the 4th goal of the B 
“ e@lassification system. 
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NOTATION 


The ,th Gaterorys 
The 4th attribute. 


Contribution of the jt) attribute to the overall 
misSion. 


Resource allocation to the ith category. 
Total resources, 

Cost per research unit in the jth caviepory. 
Number of research units in the ith category. 


Number of research units in the ith category 
corresponding the the 4th attribute, 


Total number of research units accomplished. 


Progress contributed by the it? category 
relative to the jt? attribute per dollar 


Effectiveness of the ith category relative to the 
5th attribute. 


Effectiveness of the ith category relative to all 
the attributes. 


Total effectiveness of the research program. 
Emphasis placed on the jth category. 


Effectiveness of the ith category relative to 
ail the attributes per research unit. 


Emphasis resulting on the jt goal. 
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A Brier Wesenmiperon 

Six sample problems have been constructed to evaluate 
the model. The data used are arbitrarily collected and have 
no particular significance. Problems one and two are maxi-~ 
mizations of different classification systems (called A and B) 
and describe identical research programs, These two classi- 
fication systems are initially considered to be independent 
of one another. Their interdependence 1s examined in problem 
five. Problem three experimentally combines the A and B 
systems by arbitrarily adding their functional equations. 
Problem four examines the effect of varying the range width 
mane W(C. )s on the oull@eme of problem@shree. “Problem five 
treats the B classification as an additional constraint 
equation of problem one, and maximizes this new problem. 
Problem six examines the effect of a budget reduction on 
the optimum allocation of resources to the categories. To 
evaluate the sensitivity of the solution, a sensitivity 
analysis was conducted on the input parameters of problem 
one. All problems were solved with the aid of a CDC/604 
Computer, A discussion of the results of all problems is cone 


mwirmed im the conelusions. 





General. Discussdion “for preblems One samc 


Problems one and two maximize the effectiveness of the 
identical research program by means of two assumed independent 
classification systems (called A and B). The data used in 
both problems were arbitrarily collected and are without 
particular significance. The interrelationship between 
these two problems is treated in problem five, 

Objective functions and constraint equations are 
developed for both problems and solutions are then obtained 
by usine linear programming techniques. An investigation 
for alternate solutions, and a sensitivitv analysis is 
conducted on problem one. 

The model inputs previously discussed will now be 


tabulated in matrix format as developed by H. Shaller [5] is: 


CO Oe Cee 
=i 


K(C, ) Day Dia coos o Pin 
K(Co) Boy p>? escees Dp 
Kee Pe Pro - Pmn 





Table 1. Data display using a matrix format 
where X = total budget 


oi) 





Problem one Maximization of the A classification system 


DATA 


= Be eee, 


CCAS ) 
aie au 21 61948) 407% 





,060=,090 ; For this 
problem 

230.156 arbitrarily 
take 

O24, 054 le = (89 Gey 0 

: Glad heya 

/010+.012 

.064=,084 ) | For simpli= 
City Ce 

ie ae > 0 - has been 


chosen a con= 
Stant value 
ot “forty 
thousand 
dollars, 


Problem One 


Objective Function 
The total effectiveness of the research pregsram is 


° 


pemonted to b 


0) 


Ne 


Seis ZZ Eye BE p,. Cladui 
Fin 7 Z Mic * aa Eee ‘ Pij AY Uy 


= 
tas 


t 


4 
oy 


For Problem one, therefore, the objective functicn to be 


maximized is: 
an eer ee , 262 Xat pag i ee pO2 i xe aa) x 
tAAYSX, t -2VKgt .372Xq + -372 oe) 


where the coefficient for x, is determined from the 


relationship 


G 
a pi, © (Aj) 
a 





Pewordingly: 
O21) (4130)4(.7)0.521)% G1) Gi 94) +e) (09g 
Constraint Equation Format 
The constraint equations are determined from the 


mec.) data. Also 





xz W(Ci)A xa 
10 
where a ke 895.3 thousand dollars 
Accordingly: 
Cy x, (in thousands of dollars) 
1 5 6 XK, Cucllino 
2 116.3 £X3£i39.9 
3 21.5 2X4 & 48.4 
4 g.5 4X44 10.8 . 
5 57.5 2X54 75.5 
6 L18.2 €%,2322.3 
? 10.8 £X,4 10.8 
8 85.5 £ AQ 36.7 
9 2414.9 £%yF304.4 
10 69.5 £X£114.6 


the objective function developed for problem one can now 


be maximized subject ts the above linear constraint equations 


by standard linear programming techniques. 
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Results of Problem one 

Table 3 displays various quantities that may be of 
interest to the research manager. Column one indicates 
the support a category should receive for maximum effective- 
ness in the research program. The total number of research 
units contributed by the ith category to the program, U; , 
Meeoptained by dividing x; by the cost®of a research@mmin 
of the ith category, K(C;). U; may be broken down into the 
number of research units which correspond to a particular 
attribute by the relationship: 


U-s = De; UF 


Therefore: 


BG xT i 


0.090 


O2UrD 





fable 2 = he u-= array distribution of units of research 
| versus” dollar input. 
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Three other quantities may be of interest to the 


research manager. They are: 


2 eae es 
a 13 
iy BE: as 
Cc ie = 

. la 





th 


Effectiveness of the i category relative 


to tie 3th attribute and is defined by 

E> pig CCA) 
Effectiveness of the ith category relative 
to all the attributes per research unit and 


is defined by 


/ 


n 
Fi, = Bij 


= Effectiveness of the it? category relative 


to all the attributes and is defined by 


Table 4. The effectiveness array versus categories. 


34 





- )0 
Total system effectiveness = 6 = 2 Eig = 747 wnits 
This method of displaving data, (H. ohaller L4&]}) inci- 
eates how much a catepory contributes to @ particular 
attribute. Thus category four has the greatest contri+= 


bution to attribute two. An increase in emphasis on 


Attribute two mav vossibly be accomplished by increased 
Suoport to category four. 


Beeecrnate Solution to Problem one. 


PSE. Oy tee ee I 


pa alternate solution, determinec bY Stands a 2 nea 





Caterorv allocations which 
problem cne.,. 





As two solutions exist to problem one, any convex 
combination of these solutions will maximize this problem, 


as given under column heading of General Solution, 


sensitivity Analysis of Problem One; 
A sensitivity analysis was conducted on problem one 
to determine the extent of dependence of the solution upon 
the input parameters, Standard Linear programming proced- 
ures were used to determine this dervendence. The results 
are es follows: 
A. Sensitivity of the coefficients in the objective function, 
After completing the linear programming procedures, it 
was found that the following relationship among the co= 
efficients must exist if an optimal solution is to be 


Heomtained, 


3 : to! ‘ cee a) teers EE 
eee ont E (bE gies 2 be 2 ee eeNer ener nS 


where: in the sample problem: 


SE bee 


é a 


ee 399 eee 

/ ’ 

L, = 6 240 Ey = 145 

Eee . 260 Bey eZee 

‘ ey: ‘ — “y @ 

Ey = mi 7 Eq = ore 

EB, = .521 we 
Therefore the solution is most sensitive to an increase 
4 . _# . ae 

in E,5) and EY aNnG eGG cr flCCrease fil ae Peis, GoeG@el ied 

/ “ "\ 
as Ete Ey = = pi; C (Aj) 
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Changes in the ce can now be examined. As was vreviously 
meted under Model Inputs, the contribution an attrepuce is 
to make to the overall mission will originate from the 
upper levels of an organization. Changes, therefore, that 
do not affect equation one -~Ll not change the 
optimality of the solution previously attained. If 
_equationlis no longer true, however, the problem must be 
re-run, 

To investigate the reliability of the solution, the 


research manager would be interested in noting the effect 


of varving the P38 upon the solution. An example of 
fidas 1S: 


Example 


Original Ds 
SCarerory tate 


New eS Eon 


category six 





original ae worl 


new 


Consequently, optimality is still maintained. 
J mo, 2 
SVL S =“eq thcrease 10,2 at wile -expense7Or samy 


other Pio ‘ would clearly change the optimal solution. 
9 » 


SOQ 





ieee oensitivity of the WCC; )s 


tet WCC.) upper bound Demian o met -lae 
WCC; ) lower Dound@bemdene cad spy, 
The optimal solution is maintained providing the 


following relationship exists. 


Equation (2) X = bh= B£ &K=- ba 


Baerc §6B=b, + bt bL +b, +b tds +D 7 Do a Des ce oe 
and where X = total budget = $895,300. 
In problem one this relationship is 


590,959 £ O2257 = boUae 


Miererore; a change in the W(C;) that leaves equation (2) 


unchanged will not affect the optimality of the solution. 


Example 


original beg= 214.9 new kq= 254.9 


= 


be = Oe 5 - ae 
Be. Oe b= 20.8 


mimerefore 8B = 642,7 X=Dg =~ 640 24 


B is not less than X = b and the problem 


q 


must be rerun. 


Problem Two 
Problem tr7o 18 formulated so that the Ors ANG Ene 


oy 





}(C, )"s are the same as that of vrobiem one. A comparison 
of category emvhasis between these two problems can then 
be made. A new classification system 18 used which cone= 
Sists of three attributes instead of the seven used in 
problem one, The ae and the ee will therefore not 
be identical to those used in the previous problem. The 


classification system used in problem two will be denoted 


eas the B system. 


See 


o-060=, 


lake 








Sb 7ectiv¥E function for problem two3 
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same as that of problem one. 


Results of Problem two, 


Sa i tes I ee — 


The results of problem two are disolaved in tables 
seven and eight. Column one in table seven indicates the 
Support a category should receive for maximum effectiveness 
in the research program, using this particular classifi-= 
cation system. U; is again calculated from the definition: 


Us = Xe 
mls 


ve) 


Columns four through six indicate the u;.s for the B 
J 


classification system, Columns seven through twelve indicate 


the Uis values for the A classification system of problem 
one, using the x; values of problem two. An exampie of 
the effect of using the x; values of probiem two on the 
A system is the decrease of 4,7, from .20 to .13 whiie ug} 


increased from .59 to ,.72. As expected, changing the level 


rts 


ee Caterory Suptor. will affect the amount 2 caterer, 





contributes to a particular attribute and to the entire 
pregram. Table eight 1S computed in an identical manner 
to that of table three in problem one. Columns one through 


mmree indicate the ee of the B system. Columns fove were 


J 
Mave display £;: and E, respectively. Column six a6) ene 
new E;. of the A system when using the category supports 


of the B system. An example of the change in Eja of the 


meerotem is the décrease in E;5 frome 306 omic. 


OPTIMIZATION OF "B" CLASSIFICATION SYSTEM 


x, Br |B : eles i) eos 


53.7| .34 1.74] .26 | .23) .94 1.13 10.00 jo.00 .13! 
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Table 7. The U-= array: distribution of units of researcr 
versus dollar input 
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2, The effectiveness matrix versus categories, 








Table 9 indicates the results of apovlying the optimum 
set of categorv supports obtained in the A system of vroblem 
one to the B system of problem two. Using the x; of 


propler one, therefore, we obtains 





Liv : Es ¢ : 
[Fo le 2 ee 


1 80.6 oe ane oe eS aloe 0024 esas sfug 






fem 6.s [lL,lo) A Osa to7 ot 4S s1S3 5036 eso co 2 
3 2Ziss 10.00] O22 3) 050.) | Cais 0.00 0,00 0.00 o 00 
Ly BOS -POs00) Os 0D eG Ue O tru 0.00 0.00 0.00 0.00 
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Table 9, Application of the optimum set of categorv 
supports obtained in the A system of pro’ em 
one to the B system of problem two. 
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Graph 2. Dollar input v: Category: A comparison of 
the results of the A and B classification 
svstems in problem one and two respectively. 


A = classification 
system (optimized) 


Bwkewee lassen Vocation 
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Problem II] 

The A and B classification systems were combined by 
arbitrarily adding the like components of their functional 
equations to determine the relationship, if any, between 
this problem and problems one and two. The resulting problem 
waS to maximize the equation; 

THBX, +6574 Xq+,262 x,t 471 Xyt.521 Xet 2737 xBr.581 XZ 


+ .597 xgt 4.849 xgt 849 Xo 


SO c0 Pores. 


a 
iT 


Number of research units in 
the ith category 


cm 
ti 


Total effectivencce” 16,22 sun cc 





Table 10. Results of problem three, maximization of 
function determined by summing corresponding 
components of A and 8 classification systems. 


ey 





Dollar Input 


Classification Systems 








Low High A B A+B 
xy oo / 5 = same 
H = high 
Xo vos L = low 
X4 Zone) 
Xy Sard 
Xe Ses, 5 From the results indicated 
X_ {118.2 indicated in table 8, no 
Xo OS particular relationship can 
Xp aio be discerned between problem 
Xqg Zieh. 2 three and problems one and two. 
X19 Sol 
Table 11: A comparison of values which maxir ized 


effectiveness of the A, B, and A+B classi- 
cation systems. 


meoblem 4 

In some instances a larger degree of uncertainty may 
exist on the part of the research manager concerning the 
range of separation between the lower and upper bounds 
of a category. Therefore, vreblem four was run to note 
any effect on the results of problem three by initiallv 
choosing a wider range of category emphasis bounds. 


Accordingly, the W(C. )s of problem three were varied 


by increasing the range between the lower and upper bounds 


4S 





of each category. The lower and upper bounds were lowered 
and raised respectively by equal amounts for all categories. 
Maximization of problem three with respect to these new 
constraint equations was then performed. The bounds were 
varied in this manner four times, with the results indicated 


in table 12, 
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Prep lem 5 

Since the research manager is usually confronted with a 
Situation in which his categories simu’taneously emphasize 
attributes of different classification systems, the model 
1s more realistic when classification systems are coupled. 
Problem 5 was run to determine what relationship exists when 
two classification systems, A and B, of problems one 
and two, respectively, are combined. 

Therefore, a solution was obtained to the vroblem of 
maximizing the A classification systenls objective function 
using the object function of the B system as an additional 
constraint equation. Values chosen for the B system function, 
while acting as a constraint equation for the A system, 
ranged from its maximum value of 343,69 (obtained from 
jmeoplem two) to 332.0. The lower value je3c2 7 Une e> 
determined by evaluating the B system function with respect 
to those x values which had maximized the A system. The 
results of problem five are displayed in table 13 and 
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meoalem 

Prohlem six investigates the effects of a budget cut, 
a oroblem sometimes encountered by the research manager. 
After maximizing nroblem five, part five, the total budget 
was cut from $895,300 to $825,300. The effects of the 


budget decrease on the optimal solution of the problem are 


ayed tn table 14. Care was taken in choosing the new 


rd 


disp 
tota® budset to remain above the sum of the lower budget 


memes of all categories. 
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Comparison of results of category emphasis 
before and after budget cut, 
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CONCLUSIONS 
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CONCLUS EONS 

in the introduction, various questions were raised that 
were of interest to the research manager; An examination 
of the results of the six problems and the sensitivity 
analysis enables us to answer these questions. 

Results of problem one reveal several facts that are 
in agreement with intuition. After examination of the E: 
column, (page BH), emphasis would intuitively be placed on 
Go, Cus Cl, C9, and the remaining cateperies Sig opi 
their descending amounts. The intuitive allocation method 
would emphasize those categories which contributed the 
greatest amount to the research program, per unit of re= 
search. The upper values of these categories should alwavs 
be chosen in descending order of their contributicn until a 
point is reached in the allocation process that necessi-g 
tates a shift to the lower bounds of the remaining categor= 
ies. This emphasis shift would, of course, be necessary 
in order for the program to remain within the total budget, 
The results of the linear programming technique on problem 
one were in agreement with those derived from the above 
intuitive considerations, 

Problem one has an aiternate solution. Hewever, this 


Situation cannot always be expected. An interpretation of 


this situation is that the research manaper has an alternative 
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program he may follow and still achieve optimum results. 
In this problem, resources have been shifted from C9 to 
C10, resulting in maximum emphasis on this category. 
Actually, any convex combination of these two solution 
sets would also be optimal. An alternate solution would 
also be advantageous in possibly increasing the effective= 
ness of other classification systems. Thus, if greater 
emphasis is desired placed upon an attribute of another 
classification system no loss in program effectiveness need 
occur. A shift to the alternate solution might increase 
the emphasis on this attribute while still maintaining 
the Same maximum effectiveness as before, 

The relabilityv of any output is determined to a 
great extent by the sensitivity of the results on the 
input parameters. In the sensitivity analysis conducted 
on problem one, the results (page 36) indicate that 
category nine is of major importance, Examination of these 
data indicates that the solution of the problem is most 
sensitive to changes in categories 10, 6, and 1, in that 
order, and fairly insensitive to changes in the other 
coefficients. With this information, emphasis changes 
in the CCA; ) can now be analyzed. 

As each cost coefficient is derived from the equation 
Be = 2 pij © fAd) uncertainty in the exact value of Pi4 May 
affect the ordering relationship above and thus affect the 
solution. Assuming our values of oy4 are reliable, a change 
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am the CCA:) that does not affect the crderiny saa. ee 
of the categories, will not change the existing program. 


Examining the analysis of the W(C.)s, several interest- 


ing facts emerge. All categories except category nine have 
cone bound that has no effect on the solution. The lower 
bound on category one and the upper bound on category two 
are examples of this, Category nine is the exception, as 

is indicated by the results. If a shift in category 
emphasis is however desired, the quantity B is the indicator 
on how to proceed. Thus, if it is desired to place more 
emphasis on category one, two alternatives are available 

to maintain optimality. One alternative would be to still 
maintain the relationship xX - Dg 4 BEX Seba 
The second alternative would be to shift resources among 
the variables of which B is a function. Thus, resources 
could be taken from category two, or a combination of 
categories to accomplish this emphasis change. This in= 
formation would, of course, also assist the research 
manager in determining what values to perturb in investi- 
gation of other solutions. 

Problem two also satisfies our intuition with respect 
to the E;', Here Eg! has the greatest value of all the 
categories, Once apain, intuition would indicate that the 
greatest emphasis shculd be placed on category nine. After 


considering the total budget, a change of emphasis to the 


remaining category's lower bounds would then take place. 


Ee. 





After solvinp the problem by linear programming techniques, 
the solution was found to apree with that of the intuitive 
approach, 

Whether this method can be generally emploved is a 
question for further investigation. If the intuitive 
approach proves correct, linear programming techniques need 
not be used to maximize individual classification systems. 
As the intuitive approach was unsuccessful in prediceting 
results for coupled classification systems as in problem 
five, linear programming techniques may be highly useful 
in these situations. 

The maximization of the B system results ina lossd@ 
(0.40) units of research as measured in the A system. A 
comparison of these two systems in graph two can be mis= 
leading. Graph two indicates that to change the emphasis 
from the A to the B system, categories 1, 5, 6, and 9 
should be perturbed. This 1s not the case, however, as 
problem 5 indicates. A vroblem also arises in finding 
the best position between these two extremes and determining 
the extent to which the categories should be re=-emphasized, 
This information is also revealed in vroblem five. 

The summing of the A and B system would be of interest 
if such a relationship had a particular meaning to a 


research organization. It was done here for exnerimental 
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Durposes. AS a new funct.On WaS created BYSthis Geena eron., 
it is reasonable to suppose that the resulting set of 

x's which maximize this problem could not be predicted. 
such was the case. 

Changes to the W(C;)"s were accomplished and the 
results are displayed in table 12. These results are in 
accordance with theory in that no significant change in 
the x values chosen occurs. For categories 1, 3, 4, 5S 
and 7, the lower bounds were eventually placed at zero to 
note any effect upon the results. No change in category 
emphasis occurred. Placing a lower bound of a category 
at zero can assist the research manager in deciding whether 
to support a particular category. This situation may 
arise when a new category is to be added to an existing 
pregram or when a question of continuing support to a 
Category is raised. If; for examplege the sec of WiC 
in Problem 4, Part 4, had been chose, categories 3, 4, 5S, 
and 7 would not have been supported while category one 
would have received support. 

In Problem 5, the A classification system was optimized 
with respect to the B classification system for various B 
values. This problem can aid the research manager in 
determining to what degree to vary a category and how this 


variance will change effectiveness of a particular system. 


of 





Thus, a svecific guide concerning the method of increasine 
emphasis on attributes of other classification systems is 

at hand. Table 13 would indicate the optimal manner by 
which resources should be allocated to accomplish this. A 
directive to increase emphasis ona varticular attribute 

can now be optimally accomplished using a specified category 
reemphasis. 

Graph 3, the maximum effectiveness comparisor between 
the A and B classification svstems, 1S non-linear, 
Specifically, a loss of one unit of effectiveness from 307 
to 306 units in the A system results in a net gain to the 
B svstem of 4.7 units. <A decrease of the A system from 
3606 to 305 units results in a lower gain of 3.5 units. 

A research manager might feel that a loss of two units in the 
A svstem was worth the increase of eight units in the B 
svstem. As this problem represents reality to a greater 
desree than do the others, it is the most importent. 

The point at which the A svstem equals 306 units is 
of interest. This point is the intersection between the two 
Hines of slope 3.56 and 4.73. A DOA’nt of Ghanerip slore 
on the graph may result due to the particular configuation 
@i the objective functicn that 1S Maximized, Purtheres tudy 
is needed to explain this phenomenon. 

Problem 6 reveals the results of a cut in the budget. 
The results indicate that all categories are placed at their 


lower limit with the excention of catesory nine, 





of adjustment will not always be the case but will devend 
on the amount that the budget is cut. Category 9 received 
the remainder of the tunds available after all other 
categories had been supported to their lower limit. As 
Category 9 has the highest Elms this reapportiaineam-tned 
is in agreement with intuition, 

To evaluate the effect upon the system by the addition 
of a new category, the problem can be altered to fit these 
new conditions and the program re-run, 

In the hands of a skilled research manager, the 
Linear programming technique can be a valuable aid. By 
recognizing the limitations of the model and by applving 
his experience, the research manager can gain information 
on the workings of his program. If a "yardstick" is 
available to measure research output in order to bring 
greater accuracy to the Pigs, then this technique wili be 


of great interest. 
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APPEND iat 


GLOSSARY + 


Attribute = A reason for support of a category and a 
working level translation of a portion of the mission (ob= 
jective) of ONR. Hopefully, it is quantifiable. 

Balanced Program = That program which includes an 
appropriate amount of effort in everv field of service in 
which we may reasonably be expected to engage is a balanced 
orogram. The operative factors are therefore the list of 
services required by the ONR Mission (1i.,e., Objectives) and 
the proportions of the total effort to be devoted to each, 

Boundary Conditions = The constraints on allocation of 
resources to categories. 

Cetegory = A research efiopt composed (of fame ta. 
tasks which have a common center of interest. The division 
is one which should provide a unit convenie: t for planning 
purposes, rather than being related to description of the 
total program as in the case of "projects" and "sub-projects." 


Mission - The job imposed by orders, instructions, 


ee 





eerectives™ and the like, In Using” the vterm gre snourd -b- 
made clear what group is being referred to, as "Navy Mission," 
etc. The ONR Mission is defined in comvlete detail by ONR 
[instruction 5430.18 of 16 August 1950 


lag Hoc Research Planning Committee at the Office of 
Navel Research 


62 





Objectives = A more detailed description of the ONR 
Mission. An objective is thus one of the services, the 
sum of which constitute the ONR Mission. 

Propram = Used without an adjective, the sum total of 
the efforts directed toward accomplishment of the ONR 
Mission. The Research Program is that portion of the effort 
which is under the cognizance of the Assistant Chief for 
Researcn. 

Project - The long--ange effort of a developing agency 
which extends over the full time span of the development of 
a system, or that which constitutes classes of work that 
continue indefinitely. Each project appears as a line 
item in the Annual Navy RDT&E Program. (Definition required 
by DOD Directive 5200.10, 1 August 1962). See also "category", 
"subproject"™. 

Requirement - A vlan or statement indicating tiesneed 
or demand for personnel, equipment, supplies, resources, 
facilities or services by. specific quantities, for specific 
periods of time or at a specific time (JCS Pub. 1). 

Research Planning = The process 0% idefinmingecourscs 
of action to be employed in achieving an effective and 
balanced research program and the communication of this process 
to other interested organizations. The selection of courses 


of action through a systematic consideration of alternatives. 


6 3 





Technological Barrier = An area of ignorance that 


prevents the development of a desired end item or capability. 
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APPEND is 


DETAILED PROBLEM ONE FORMULATION 


Appendix two consists of the intermediate steps in- 
volved in solving problem one. They are provided to assist 
the reader in reproducing these same results. The notation 
used may be found in Garvin [1]. 

PORMULATION FOR COMPUTATION BY SIMPLEX MEti De eee 
Maximize [1 €,.999x, # .240x 4% .262 3% ees 2 eee ee 


+.311 x + ,145 x + .234 x + (372K + .372 x +) J 
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SUBU ECT PIO 


lS eS | = X11 aoa 


2. xX, + xz2 = 80.6 
oe a5 - X73 =[lo.c 


uy => - X14 ese 


tk 


or Xz, = 15 Zs 


be x3 2 X16 = 48,4 


thi 
© @) 
¢ 
(Oo 


xy Se XL7 
So x + x18 = ears 


~ Oo Xe = ALY = Ss 


IG coo. o 7 Ses 
Aes =118,2 
12, Ke o> =S2253 
Var ey ee 10.8 


Ee xX ko = Uae 
Xo = &95 = 89.9 
Lo. ce) 0G) = JOn t 
aie Xg = X27 =214.9 


Ge, XQ + X7Q =o 4 


1S. “30 = x99 = S)6 5 

20. 20) ote X30 =f lo 
£Q 

oo, Shaq 28853 
eye 2 


where xy thru Xo, are slack variables 
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APPEMDIX 72m 
Examples of Attributes, Branches, Categorias &n4 


cation Svstem reprinted from the Ad Hoc Research 
Committee Report. 


List of Some Existing Attributes = Not Indepe 
1. Sel1entific value 
2. Military value 
3. Technological value 
4, Windows 
5. lLCissemination 
6. Coordination of Research 
7, Prestige 
8, Contract with Scientific Community 
9. Pressures and interests 
10. Existance of adequate programs within other 
agencies 


lo Industrial incentive 


Pact lai bist oO. ONRk BRraenehec 
Ll. Acoustics Branch 
2. Georgraphy Branch 
3. Geophysics Branch 
%, Field Projects Branch 
9. Metallurgy Branch 


6. Chemistrv Branch 


Cisaesif ix 


P eean 1 ire 


nedernt 


a 





Propulsion Chemistry Rranch 
Power Branch 

Physics Branch 

MIhiclear Phvsics Branch 
Electronics Branch 

Mathematics Branch 

Logistics and Mathematical Statistics branch 
Information Systems Branch 
rluid Dynamics Branch 
Structural Mechanics Branch 
Physiology Branch 

Biochemistry Branch 
Microbiology Branch 

Medicine and Denistry Branch 
Biology Branch 

Group Psvchology Branch 
Physiological Psychoiogy Branch 
Engineering Psychology Branch 


Personnel and Training Branch 


Breakdown of Electronics 4ranch into Cata@cmries 


meeclRONICS BRANCH 


Areas of New Emphasis 


ay 
De 


Submarine Detection 
Communications 


Communications Theory 


ee 


sen? 
tad 





Cumren tobng@grem satego aie. 
a, Circuit Analysis and Synthesis 
b. Information Theory and Coding 
c, Data Processing 
d. Bio=Rlectronics 
Physical Llectronics 


Current Program Categories 


a, Solid State Electronics 
b. Cathode Characte-istics (Thermionics, Fiel: 
Ge. biectron baltescarc= 

d. Plasma Studies 

Eiectromagnetic Wave Propcgation and kadiation 


Current Program 4 veee es 


a, Anomalous Propagation Mcdes 
Be > Vist dneaecr 

c. Antennas 

d. Geomagnetics 

en, irection Finding 
Electronic Components 


Current Program Categories 
Solid State Devices 
bo Microelectronics 
c, Electron Tubes 
d. Application of New Materials 
Radio Astrophysics 


Current Program Catepories 


Solar Fiare Studies 

Radio Source Positioning 
Cosmology via Radio Astronomy 
Planetary Astronomy 


c 


c 


Oo 9 O 


c 
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ries 


IV. 


Examples of Classification Systems Now In Use 





Ay. “SHOPPE hate 

B. Intermediate Range 
C, Long Range 

D. Other or combination 


ENVIRONMENTAL (Spatial) 


A, Aero Space 

B, Surface (Water, Land, Amphibious) 
C, Underseas (ASW, Mining Submarine) 
D. Other or combination 


CONVENTIONAL 


A, Engineering 

B. Operations 

C. Deck 

D. Ordnance 

Ee Aviation 

F. Medical/Dental 

Ge supply 

H, Other or combinations 


DPPENSIVE/ DEEN Sey. 


Ag sO0Ttencive 
B. Defensive 
CC. Other or Combination 


FUNCTIONAL OPERATIONAL 


A. Surveillance 

B,. Command control 
C, Intelligence 

De ioe tear 1on 

E. Delivery Platform 
Po? Vileersties 





VI. 


VIT. 


veld 


5 a 

Earth Sciences 
Material Sciences 
Paivstecat s5eLlences 
Mathematical Sciences 
Biological Sciences 
Psychological Sciences 
Operations Analysis 
Other or combinations 


FUNCTIONAL BY BROAD MISSIO! 


Applied Research 

Basic Research 

Development Test §&§ Evaluation 
Management & Support 


BUDGET ACTIVITY (End Item Categories) 


A. 


Military Sciences 

Aircraft and Related Equipment 
Missites and Related Equipment 
Ast. onautics 

Ships and Small Craft 

Ordnance Combat Vehicles 

Other Equipment 

Program Wide Management Support 
Militarv Family Housing 
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